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Abstract. We study the complexity of automatic structures via 
well-established concepts from both logic and model theory, in- 
cluding ordinal heights (of well-founded relations), Scott ranks of 
structures, and Cantor-Bendixson ranks (of trees). We prove the 
following results: 1) The ordinal height of any automatic well- 
founded partial order is bounded by w'^; 2) The ordinal heights of 
automatic well-founded relations are unbounded below wp^, the 
first non-computable ordinal; 3) For any computable ordinal a, 
there is an automatic structure of Scott rank at least a. Moreover, 
there are automatic structures of Scott rank uif^ ,iu^'^ -I- 1; 4) For 
any computable ordinal a, there is an automatic successor tree of 
Cantor-Bendixson rank a. 

1. Introduction 

In recent years, there has been increasing interest in the study of 
structures that can be presented by automata. The underlying idea is 
to apply techniques of automata theory to decision problems that arise 
in logic and applications such as databases and verification. A typical 
decision problem is the model checking problem: for a structure A (e.g. 
a graph), design an algorithm that, given a formula 4>{x) in a formal 
system and a tuple a from the structure, decides if (f){a) is true in A. 
In particular, when the formal system is the first order predicate logic 
or the monadic second order logic, we would like to know if the theory 
of the structure is decidable. Fundamental early results in this direc- 
tion by Biichi ([6], [7j) and Rabin ([27J) proved the decidability of the 
monadic second order theories of the successor on the natural numbers 
and of the binary tree. There have been numerous applications and 
extensions of these results in logic, algebra [12j, verification and model 
checking [3D] [21], and databases [22] • Moreover, automatic structures 
provide a theoretical framework for constraint databases over discrete 
domains such as strings and trees [1]. Using simple closure properties 
and the decidability of the emptiness problem for automata, one can 
prove that the first order (and monadic second order) theories of some 
well-known structures are decidable. Examples of such structures are 
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Presburger arithmetic and some of its extensions, the term algebra, the 
real numbers under addition, finitely generated abelian groups, and the 
atomless Boolean algebra. Direct proofs of these results, without the 
use of automata, require non-trivial technical work. 

A structure A = {A; Rq, . . . , R^) is automatic if the domain A 
and all the relations Rq, ■ ■ ■ , Rm of the structure are recognised by 
finite automata (precise definitions are in the next section). Indepen- 
dently, Hodgson [TB] and later Khoussainov and Nerode [T7] proved 
that for any given automatic structure there is an algorithm that solves 
the model checking problem for the first order logic. In particular, 
the first order theory of the structure is decidable. Blumensath and 
Gradel proved a logical characterization theorem stating that auto- 
matic structures are exactly those definable in the fragment of arith- 
metic {uj]+, |2,<,0), where -|- and < have their usual meanings and 
1 2 is a weak divisibility predicate for which x\2y if and only if a; is a 
power of 2 and divides y (see [5]). In addition, for some classes of 
automatic structures there are characterization theorems that have di- 
rect algorithmic implications. For example, in \iQl, Delhomme proved 
that automatic well-ordered sets are all strictly less than ut'^. Using 
this characterization, [12] gives an algorithm which decides the isomor- 
phism problem for automatic well-ordered sets. The algorithm is based 
on extracting the Cantor normal form for the ordinal isomorphic to the 
given automatic well-ordered set. Another characterization theorem of 
this ilk gives that automatic Boolean algebras are exactly those that 
are finite products of the Boolean algebra of finite and co-finite subsets 
of u [201 • Again, this result can be used to show that the isomorphism 
problem for automatic Boolean algebras is decidable. 

Another body of work is devoted to the study of resource-bounded 
complexity of the model checking problem for automatic structures. 
On the one hand, Gradel and Blumensath ([5]) constructed examples 
of automatic structures whose first order theories are non-elementary. 
On the other hand, Lohrey in [25j proved that the first order theory of 
any automatic graph of bounded degree is elementary. It is noteworthy 
that when both a first order formula (p and an automatic structure A 
are fixed, determining if a tuple a from A satisfies (plx) can be done in 
linear time. There are also feasible time bounds on deciding the first 
order theories of automatic structures over the unary alphabet ([1], 
[22]). 

Most current results demonstrate that automatic structures are not 
complex in various concrete senses. However, in this paper we use 
well-established concepts from both logic and model theory to prove 
results in the opposite direction. We now briefiy describe the measures 



MODEL THEORETIC COMPLEXITY OF AUTOMATIC STRUCTURES 3 



of complexity we use (ordinal heights of well-founded relations, Scott 
ranks of structures, and Cantor-Bendixson ranks of trees) and connect 
them with the results of this paper. 

A relation R is called well-founded if there is no infinite sequence 
Xi, 0:2, X3, . . . such that {xi+i^Xi) E R for i E u. In computer sci- 
ence, well-founded relations are of interest due to a natural connection 
between well-founded sets and terminating programs. We say that a 
program is terminating if every computation from an initial state 
is finite. This is equivalent to well-foundedness of the collection of 
states reachable from the initial state, under the reachability relation 
[3]. The ordinal height is a measure of the depth of well-founded re- 
lations. Since all automatic structures are also computable structures, 
the obvious bound for ordinal heights of automatic well-founded rela- 
tions is uf^ (the first non-computable ordinal). Sections [3] and H] study 
the sharpness of this bound. Theorem 11.11 characterizes automatic well- 
founded partial orders in terms of their (relatively low) ordinal heights, 
whereas Theorem 1 1 . 2 1 shows that uf^ is the sharp bound in the general 
case. 

Theorem 1.1. For each ordinal a, a is the ordinal height of an auto- 
matic well-founded partial order if and only if a < uj'^ . 

Theorem 1.2. For each (computable) ordinal a < OJ^^ , there is an 
automatic well-founded relation A with ordinal height greater than a. 

Section [5] is devoted to building automatic structures with high Scott 
ranks. The concept of Scott rank comes from a well-known theorem 
of Scott stating that for every countable structure A there exists a 
sentence in L^^^^-logic which characterizes A up to isomorphism [29j. 
The minimal quantifier rank of such a formula is called the Scott rank of 
A. A known upper bound on the Scott rank of computable structures 
implies that the Scott rank of automatic structures is at most uo^^ + 
1. But, until now, all the known examples of automatic structures 
had low Scott ranks. Results in [25j, [lOj, |21] suggest that the Scott 
ranks of automatic structures could be bounded by small ordinals. This 
intuition is falsified in Section [5] with the theorem: 

Theorem 1.3. For each computable ordinal a there is an automatic 
structure of Scott rank at least a. 

In particular, this theorem gives a new proof that the isomorphism 
problem for automatic structures is E]^-complete (another proof may 
be found in pO]). 




In the last section, we investigate the Cantor-Bendixson ranks of 
automatic trees. A partial order tree is a partially ordered set (T, <) 
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such that there is a <-minimal element of T, and each subset {x G T : 
X < y} is finite and is hnearly ordered under <. A successor tree 
is a pair (T, S) such that the refiexive and transitive closure <s of 
S produces a partial order tree (T, <s)- The derivative of a tree T 
is obtained by removing all the nonbranching paths of the tree. One 
applies the derivative operation to T successively until a fixed point is 
reached. The minimal ordinal that is needed to reach the fixed point is 
called the Cantor-Bendixson (CB) rank of the tree. The CB rank 
plays an important role in logic, algebra, and topology. Informally, 
the CB rank tells us how far the structure is from algorithmically (or 
algebraically) simple structures. Again, the obvious bound on CB 
ranks of automatic successor trees is 00^^. In [19], it is proved that 
the CB rank of any automatic partial order tree is finite and can be 
computed from the automaton for the < relation on the tree. It has 
been an open question whether the CB ranks of automatic successor 
trees can also be bounded by small ordinals. We answer this question 
in the following theorem. 

Theorem 1.4. For a < uj^^ there is an automatic successor tree of 
CB rank a . 

The main tool we use to prove results about high ranks is the configu- 
ration spaces of Turing machines, considered as automatic graphs. It is 
important to note that graphs which arise as configuration spaces have 
very low model-theoretic complexity: their Scott ranks are at most 3, 
and if they are well-founded then their ordinal heights are at most uo 
(see Propositions 14.31 and 15. 3p . Hence, the configuration spaces serve 
merely as building blocks in the construction of automatic structures 
with high complexity, rather than contributing materially to the high 
complexity themselves. 
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2. Preliminaries 

A (relational) vocabulary is a finite sequence (P["\ . . . , -P™S ci, . . . , c^), 
where each P™"^ is a predicate symbol of arity rrij > 0, and each Ck 
is a constant symbol. A structure with this vocabulary is a tuple 
, cf, . . . , c^), where and are interpretations 
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of the symbols of the vocabulary. When convenient, we may omit the 
superscripts A. We only consider infinite structures, that is, those 
whose universe is an infinite set. 

To establish notation, we briefly recall some definitions associated 
with finite automata. A finite automaton Ai over an alphabet S 
is a tuple {S, l, A, F), where S" is a finite set of states, l & S is the 
initial state, AcSxT^xSis the transition table, and F C S* is 
the set of final states. A computation of ^ on a word cria2 • • • o"„ 
(cTj G S) is a sequence of states, say qQ,qi, . . . ,qn, such that qo = l 
and (g,, o"j+i, qi+i) G A for alH G {0, . . . , n — 1}. If g„ G F, then the 
computation is successful and we say that the automaton Ai accepts 
the word o"icr2 . . . cr„. The language accepted by the automaton Ad is 
the set of all words accepted by A^. In general, D G T,* is finite 
automaton recognisable, or regular, if D is the language accepted 
by some finite automaton At. 

To define automaton recognisable relations, we use n-variable (or n- 
tape) automata. An n— tape automaton can be thought of as a one- 
way Turing machine with n input tapes [llj. Each tape is regarded as 
semi-infinite, having written on it a word over the alphabet S followed 
by an infinite succession of blanks (denoted by o symbols). The au- 
tomaton starts in the initial state, reads simultaneously the first symbol 
of each tape, changes state, reads simultaneously the second symbol of 
each tape, changes state, etc., until it reads a blank on each tape. The 
automaton then stops and accepts the n-tuple of words if it is in a 
final state. The set of all n-tuples accepted by the automaton is the 
relation recognised by the automaton. Formally, an n-tape automaton 
on S is a finite automaton over the alphabet (So)", where = SU {o} 
and o ^ S. The convolution of a tuple {wi, ■ ■ ■ ,Wn) G S*" is the 
string c{wi, ■ ■ ■ , Wn) of length maxj \wi\ over the alphabet (So)" which 
is defined as follows. Its fc'th symbol is (ai, . . . , cr„) where ai is the 
fc'th symbol of Wi if k < \wi\ and o otherwise. The convolution of 
a relation R C S*" is the language c{R) C (So)"* formed as the set 
of convolutions of all the tuples in R. An ra-ary relation R C S*" is 
finite automaton recognisable, or regular, if its convolution c{R) 
is recognisable by an ra-tape automaton. 

Definition 2.1. A structure A = {A; Rq, Ri, . . . , Rm) is automatic 
over S if its domain A and all relations Ro, Ri, . . ., Rm are regular 
over E. If i3 is isomorphic to an automatic structure A then we call A 
an automatic presentation of B and say that B is automatically 
presentable. 



6 



BAKHADYR KHOUSSAINOV AND MIA MINNES 



The configuration graph of any Turing machine is an example of an 
automatic structure. The graph is defined by letting the configura- 
tions of the Turing machine be the vertices, and putting an edge from 
configuration Ci to configuration C2 if the machine can make an instan- 
taneous move from Ci to c^- Examples of automatically presentable 
structures are (M, +), (N, <), (N, S"), (Z, +), the order on the rationals 
(Q, <), and the Boolean algebra of finite and co-finite subsets of N. In 
the following, we abuse terminology and identify the notions of "auto- 
matic" and "automatically presentable" . Many examples of automatic 
structures can be formed using the tu-fold disjoint union of a structure 
A (the disjoint union of uj many copies of A). 

Lemma 2.2. p8] // A is automatic then its uj-fold disjoint union is 
isomorphic to an automatic structure. 

Proof. Suppose that A = {A; Ri, R2, . . .) is automatic. Define A' = 
{Axr;R[,R'„...)hj 

{{x,i),{y,j)) e R'^ i = j Sz {x,y) e Rm, m = l,2, .... 

It is clear that A' is automatic and is isomorphic to the tu-fold disjoint 
union of A. □ 

The class of automatic structures is a proper subclass of the com- 
putable structures. We therefore mention some crucial definitions and 
facts about computable structures. Good references for the theory of 
computable structures include [H], fl8\. 

Definition 2.3. A computable structure is ^ = {A; Ri, . . . , Rm) 

whose domain and relations are all computable. 

The domains of computable structures can always be identified with 
the set uj of natural numbers. Under this assumption, we introduce 
new constant symbols c„ for each n E lu and interpret Cfi clS Ti. We ex- 
pand the vocabulary of each structure to include these new constants 
c„. In this context, A is computable if and only if the atomic dia- 
gram of A (the set of Godel numbers of all quantifier-free sentences 
in the extended vocabulary that are true in A) is a computable set. 
If A is computable and B is isomorphic to A then we say that A is 
a computable presentation of B. Note that if B has a computable 
presentation then B has u many computable presentations. In this 
paper, we will be coding computable structures into automatic ones. 

The ranks that we use to measure the complexity of automatic struc- 
tures take values in the ordinals. In particular, we will see that only 
a subset of the countable ordinals will play an important role. An 
ordinal is called computable if it is the order-type of a computable 
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well-ordering of the natural numbers. The least ordinal which is not 
computable is denoted (after Church and Kleene). 

3. Ranks of automatic well-founded partial orders 

In this section we consider structures A — {A]R) with a single binary 
relation. An element x is said to be i?-minimal for a set X if for 
each y & X, {y,x) ^ R. The relation R is said to be well-founded 
if every non-empty subset of A has an i?-minimal element. This is 
equivalent to saying that {A;R) has no infinite chains xi,X2,X3, . . . 
where G R for all i. 

A ranking function for A is an ordinal-valued function / such 
that f{y) < f{x) whenever {y,x) e i?. If / is a ranking function 
on A, let ord{f) = sup{/(a;) : x e A}. The structure A is well- 
founded if and only if A admits a ranking function. The ordinal 
height of A, denoted r{A), is the least ordinal a which is ord{g) for 
some ranking function g on A. An equivalent definition for the rank 
of A is the following. We define the function by induction: for 
the i?-minimal elements x, set r^{x) — 0; for z not i?-minimal, put 
i^a{^) = sup{r(y) + 1 : (y.z) G R}. Then r_4 is a ranking function 
admitted by A and r{A) = sup{r^(a;) : x G A}. For B C A, we write 
r{B) for the ordinal height of the structure obtained by restricting the 
relation R to the subset B. 

Lemma 3.1. If a < a;f^ , there is a computable well-founded relation 
of ordinal height a. 

Proof. This lemma is trivial: the ordinal height of an ordinal o; is a 
itself. Since all computable ordinals are computable and well-founded 
relations, we are done. □ 

The next lemma follows easily from the well-foundedness of ordinals 
and of R. The proof is left to the reader. 

Lemma 3.2. For a structure A = {A; R) where R is well-founded, if 
r{A) = a and P < a then there is an x & A such that r^(a;) = /3. 

For the remainder of this section, we assume further that R is a. 
partial order. For convenience, we write < instead of R. Thus, we 
consider automatic well-founded partial orders A = {A, <). We will use 
the notion of natural sum of ordinals. The natural sum of ordinals 
a, (3 (denoted a -\-' (3) is defined recursively: a -\-' = a, -\-' P = (3, 
and a-\-' (3 is the least ordinal strictly greater than j -\-' (3 for all 7 < a 
and strictly greater than ck -|-' 7 for all 7 < /3. 
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Lemma 3.3. Let Ai and A2 be disjoint subsets of A such that A = 
AiU A2. Consider the partially ordered sets Ai = {Ai, <i) and A2 = 
{A2, <2) obtained by restricting < to Ai and A2 respectively. Then, 
r{A) < «! +' a2, where ai = r{Ai). 

Proof. We will show that there is a ranking function on A whose range is 
contained in the ordinal ai +'02- For each x & A consider the partially 
ordered sets Ai^x and A2,x obtained by restricting < to {z & Ai \ z < x} 
and {z & A2 \ z < x}, respectively. Define f{x) = r{Ai^x) +'^(-^2,x)- 
We claim that / is a ranking function. Indeed, assume that x < y. 
Then, since < is transitive, it must be the case that Ai^x ^ ^1,?/ and 
A2,x C A2,y. Therefore, r{Ai^x) < r{Ai^y) and r(^2,x) < r{A2,y). At 
least one of these inequalities must be strict. To see this, assume that 
X ^ A\ (the case a; G is similar). Then since x G it is the case 
that t{^A\^x) + 1 < ''"("^1,?/) by the definition of ranks. Therefore, we 
have that f{x) < f{y)- Moreover, the image of f{x) is contained in 
ai+'a2. □ 

Corollary 3.4. If r{A) = cu" and A = AiU A2, where Ai f] A2 = 0, 
then either r{Ai) = cu" or r{A2) = tu". 

Khoussainov and Nerode [17J show that, for each n, there is an auto- 
matic presentation of the ordinal cu". It is clear that such a presentation 
has ordinal height tu". The next theorem proves that u'^ is the sharp 
bound on ranks of all automatic well-founded partial orders. Once 
Corollary 13.41 has been established, the proof of Theorem 11.11 follows 
Delhomme [10] and Rubin [28] . 

Theorem II. li For each ordinal a, a is the ordinal height of an auto- 
matic well-founded partial order if and only if a < uj^ . 

Proof. One direction of the proof is clear. For the other, assume for a 
contradiction that there is an automatic well-founded partial order A = 
{A, <) with r{A) = a>uj'^. Let {Sa, la, Aa, Fa) and {S<, 6<, A<, F<) 
be finite automata over S recognizing A and < (respectively). By 
Lemma [221 for each n > there is m„ G A such that r_4(M„) = cj". For 
each M G A we define the set 

u 1= {x E A : X < u}. 

Note that if r^(M) is a limit ordinal then r^(M) = r{u |). We define 
a finite partition of m | in order to apply Corollary 13. 4[ To do so, for 
u,v G S*, define = {vw G A : w G S* & vw < u}. Each set of 
the form u | can then be partitioned based on the prefixes of words as 
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follows: 

u i= {x e A : \x\ < \u\ L X < u}U [J X". 

(All the unions above are finite and disjoint.) Hence, applying Corol- 
lary 13.41 for each m„ there exists a f„ such that = |f„| and 
r(X,-;) = r{un i) = 00^. 

On the other hand, we use the automata to define the following 
equivalence relation on pairs of words of equal lengths: 

(m, v) ~ {u', v') Aa(6a, v) = AAilA, v') & 

A,fe.Q)=A,fe. (;;;;), 

There are at most \Sa\ x \S<\ equivalence classes. Thus, the infinite 
sequence ('Ui,t>i), {u2,V2), ... contains m, n such that m ^ n and 

Lemma 3.5. For any u, v, u', v' G S*, if [u, v) ~ [u', v') then r{X^) = 

To prove the lemma, consider g : X" X^', defined as g{vw) = v'w. 
From the equivalence relation, we see that g is well-defined, bijective, 
and order preserving. Hence X" = X", (as partial orders). Therefore, 
r(X,")=r(X«;). 

By Lemma [575| 0;™ = r(X"™) = r(X"^) = tu", a contradiction with 
the assumption that m ^ n. Therefore, there is no automatic well- 
founded partial order of ordinal height greater than or equal to cj'^. □ 

4. Ranks of automatic well-founded relations 

4.1. Configuration spaces of Turing machines. In the forthcom- 
ing constructions, we embed computable structures into automatic ones 
via configuration spaces of Turing machines. This subsection provides 
terminology and background for these constructions. Let be an 
ra-tape deterministic Turing machine. The configuration space of 
A4, denoted by Conf{M.), is a directed graph whose nodes are con- 
figurations of A^. The nodes are n-tuples, each of whose coordinates 
represents the contents of a tape. Each tape is encoded as {w q w'), 
where w, w' G are the symbols on the tape before and after the 
location of the read/write head, and q is one of the states of M.. The 
edges of the graph are all the pairs of the form (ci, C2) such that there is 
an instruction of M. that transforms Ci to C2. The configuration space 
is an automatic graph. The out-degree of every vertex in Conf{M.) is 
1; the in-degree need not be 1. 
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Definition 4.1. A deterministic Turing machine Ai is reversible if 

Conf{M.) consists only of finite chains and chains of type uj. 

Lemma 4.2. [2j For any deterministic 1-tape Turing machine there is 
a reversible 3-tape Turing machine which accepts the same language. 

Proof. (Sketch) Given a deterministic Turing machine, define a 3-tape 
Turing machine with a modified set of instructions. The modified in- 
structions have the property that neither the domains nor the ranges 
overlap. The first tape performs the computation exactly as the orig- 
inal machine would have done. As the new machine executes each 
instruction, it stores the index of the instruction on the second tape, 
forming a history. Once the machine enters a state which would have 
been halting for the original machine, the output of the computation is 
copied onto the third tape. Then, the machine runs the computation 
backwards and erases the history tape. The halting configuration con- 
tains the input on the first tape, blanks on the second tape, and the 
output on the third tape. □ 

We establish the following notation for a 3-tape reversible Turing 
machine given by the construction in this lemma. A valid initial 
configuration of Ai is of the form (A l x, A, A), where x in the domain, 
A is the empty string, and l is the initial state of A4. From the proof 
of Lemma 14.21 observe that a final (halting) configuration is of the 
form (x. A, \ qj y), with qf a halting state of A4. Also, because of the 
reversibility assumption, all the chains in Conf{M.) are either finite or 
cj-chains (the order type of the natural numbers). In particular, this 
means that Conf{M.) is well-founded. We call an element of in-degree 
a base (of a chain). The set of valid initial or final configurations is 
regular. We classify the components (chains) of Conf{M.) as follows: 

• Terminating computation chains: finite chains whose base 
is a valid initial configuration; that is, one of the form (A i x, A, A), 
for X G S*. 

• Non-terminating computation chains: infinite chains whose 
base is a valid initial configuration. 

• Unproductive chains: chains whose base is not a valid initial 
configuration. 

Configuration spaces of reversible Turing machines are locally finite 
graphs (graphs of finite degree) and well-founded. Hence, the following 
proposition guarantees that their ordinal heights are small. 

Proposition 4.3. If G = {A, E) is a locally finite graph then E is 
well-founded and the ordinal height of E is not above uj, or E has an 
infinite chain. 
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Proof. Suppose G is a locally finite graph and E is well-founded. For 
a contradiction, suppose r{G) > uj. Then there is v E A with r{v) = 
oj. By definition, r{v) = sup{r(M) : uEv}. But, this implies that 
there are infinitely many elements E-helow v, a contradiction with 
local finiteness of G. □ 

4.2. Automatic well-founded relations of high rank. We are now 

ready to prove that u'^^ is the sharp bound for ordinal heights of 
automatic well-founded relations. 

Theorem 11.21 For each computable ordinal a < tuf^', there is an 
automatic well-founded relation A with ordinal height greater than a 

Proof. The proof of the theorem uses properties of Turing machines 
and their configuration spaces. We take a computable well-founded 
relation whose ordinal height is a, and "embed" it into an automatic 
well-founded relation with similar ordinal height. 

By Lemma 13. let C = (C, La) be a computable well-founded re- 
lation of ordinal height a. We assume without loss of generality that 
C = for some finite alphabet S. Let Ai be the Turing machine com- 
puting the relation L^. On each pair {x,y) from the domain, Ai halts 
and outputs "yes" or "no" . By Lemma [4.21 we can assume that Ai is 
reversible. Recall that Conf{Ai) = {D,E) is an automatic graph. We 
define the domain of our automatic structure to he A = U D . The 
binary relation of the automatic structure is: 

R = E U {(x, (A 6 (x, y), A, A)) : x, y G S*} U 

{{{{x,y),X,Xqf "yes" ), : x, y G S*}. 

Intuitively, the structure {A; R) is a stretched out version of (C, La) 
with infinitely many finite pieces extending from elements of C, and 
with disjoint pieces which are either finite chains or chains of type u. 
The structure {A; R) is automatic because its domain is a regular set 
of words and the relation R is recognisable by a 2-tape automaton. 
We should verify, however, that R is well-founded. Let Y G A. If 
F n C 7^ then since (C, La) is well-founded, there is x G F fl C which 
is Lo-minimal. The only possible elements uinY for which {u, x) G -R 
are those which lie on computation chains connecting some z E C with 
X. Since each such computation chain is finite, there is an i?-minimal 
u below X on each chain. Any such u is i?-minimal for Y. On the 
other hand, if y fl C = 0, then Y consists of disjoint finite chains and 
chains of type u. Any such chain has a minimal element, and any of 
these elements are i?-minimal for Y. Therefore, {A; R) is an automatic 
well-founded structure. 
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We now consider the ordinal height of {A; R). For each element x G 
C, an easy induction on rc{x), shows that rc{x) < r_4(x) < u + rc{x). 
We denote by i{a, h) the (finite) length of the computation chain of M. 
with input (a, h). For any element a^^y in the computation chain which 
represents the computation of M. determining whether (x, y) G -R, 
we have r_4(x) < rj\^{ax,y) < ry^{x) + i{x,y). For any element u 
in an unproductive chain of the configuration space, < r^('u) < u. 
Therefore, since C C A, r{C) < r{A) < 00 + r{C). □ 

5. Automatic Structures and Scott Rank 

The Scott rank of a structure is introduced in the proof of Scott's 
Isomorphism Theorem [2H]- Since then, variants of the Scott rank have 
been used in the computable model theory literature. Here we follow 
the definition of Scott rank from [8j. 

Definition 5.1. For structure A and tuples a, 6 G A" (of equal length), 
define 

• a =° 6 if a, 6 satisfy the same quantifier-free formulas in the 
language of A; 

• For a > 0, d b if for all /? < a, for each c (of arbitrary 
length) there is d such that a, c =^ b, d; and for each d (of 
arbitrary length) there is c such that a, c =^ b, d. 

Then, the Scott rank of the tuple a, denoted by S7l{a), is the least 
P such that for all 6 G A", a =^ 6 implies that (A, a) = {A, b). Finally, 
the Scott rank of A, denoted by S1Z{A), is the least a greater than the 
Scott ranks of all tuples of A. 

Example 5.2. 57^(Q, <) = 1, 57^(cJ, <) = 2, and Sn{n-uj, <) = n+1. 

Configuration spaces of reversible Turing machines are locally finite 
graphs. By the proposition below, they all have low Scott Rank. 

Proposition 5.3. If G = {V,E) is a locally finite graph, SR{G) < 3. 

Proof. The neighbourhood of diameter n of a subset U, denoted Bn{U), 
is defined as follows: Bq{U) = U and BniJJ) is the set oi v eV which 
can be reached from f/ by ri or fewer edges. The proof of the proposition 
relies on two lemmas. 

Lemma 5.4. Let d,b & V be such that d =^ b. Then for all n, there is 
a bisection of the n-neighbourhoods around d, b which sends dtob and 
which respects E. 

Proof. For a given n, let c = Enid) \ d. Note that c is a finite tuple 
because of the local finiteness condition. Since d =^ 6, there is d such 
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that ac =^ hd. If Bn{b) = bd, we are done. Two set inclusions are 
needed. First, we show that di G Bn{h). By definition, we have that 
Cj G Bn{a), and let aj,Ui, . . . ,Mn-i witness this. Then since dc =^ bd, 
there are f i, . . . , Vn-i such that dcu =° bdv. In particular, we have that 
if CiEuiE ■ ■ ■ Eun-iEaj, then also diEviE ■ ■ ■ Evn-iEbj (and likewise if 
the E relation is in the other direction). Hence, di G Bn{b). Conversely, 
suppose V G Bn(b) \ d. Let f i, . . . , f„ be witnesses and this will let us 
find a new element of Bn{a) which is not in c, a contradiction. □ 

Lemma 5.5. Let G = {V, E) he a graph. Suppose a,b &V are such that 
for all n, {Bn{d), E,d) = {Bn{b),E,b). Then there is an isomorphism 
between the component of G containing d and that containing b which 
sends d to b. 

Proof. We consider a tree of partial isomorphisms of G. The nodes of 
the tree are bijections from -B„(a) to Bn{b) which respect the relation 
E and map d to b. Node / is the child of node g in the tree if dom(/) = 
Bn{d), dom{g) = Bn+i{d) and f D g. Note that the root of this tree is 
the map which sends d to b. Moreover, the tree is finitely branching and 
is infinite by Lemma 15.41 Therefore, Konig's Lemma gives an infinite 
path through this tree. The union of all partial isomorphisms along 
this path is the required isomorphism. □ 

To prove the proposition, we note that for any a, 6 in ^ such that 
d =^ b, Lemmas 15.41 and 15.51 yield an isomorphism from the component 
of d to the component of b that maps d to b. Hence, if d =^ b, there 
is an automorphism of G that maps d to b. Therefore, for each d & V, 
SR{d) < 2, so SR{G) < 3. □ 

Let C = {G; Ri, . . . , Rm) be a computable structure. Recall that 
since C is a computable set, we may assume it is E* for some finite 
alphabet S. We construct an automatic structure A whose Scott rank 
is (close to) the Scott rank of C. Since the domain of C is computable, 
we assume that C = for some finite S. The construction of A 
involves connecting the configuration spaces of Turing machines com- 
puting relations -Ri, . . . , Rm- Note that Proposition 15.31 suggests that 
the high Scott rank of the resulting automatic structure is the main 
part of the construction because it is not provided by the configuration 
spaces themselves. The construction in some sense expands C into an 
automatic structure. We comment that expansions do not necessarily 
preserve the Scott rank. For example, any computable structure, C, 
has an expansion with Scott rank 2. The expansion is obtained by 
adding the successor relation into the signature. 
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We detail the construction for Ri. Let Aii be a Turing machine 
for Ri. By a simple modification of the machine we assume that Aii 
halts if and only if its output is "yes" . By Lemma 14.21 we can also 
assume that A4i is reversible. We now modify the configuration space 
Conf{M.i) so as to respect the isomorphism type of C. This will ensure 
that the construction (almost) preserves the Scott rank of C. We use 
the terminology from Subsection 14. 1[ 

Smoothing out unproductive parts. The length and number of 
unproductive chains is determined by the machine A4i and hence may 
differ even for Turing machines computing the same set. In this stage, 
we standardize the format of this unproductive part of the configuration 
space. We wish to add enough redundant information in the unproduc- 
tive section of the structure so that if two given computable structures 
are isomorphic, the unproductive parts of the automatic representa- 
tions will also be isomorphic . We add cu-many chains of length n (for 
each n) and cj-many copies of uj. This ensures that the (smoothed) un- 
productive section of the configuration space of any Turing machine will 
be isomorphic and preserves automaticity. We comment that adding 
this redundancy preserves automaticity since the operation is a disjoint 
union of automatic structures. 

Smoothing out lengths of computation chains. We turn our 
attention to the chains which have valid initial configurations at their 
base. The length of each finite chain denotes the length of computation 
required to return a "yes" answer. We will smooth out these chains 
by adding "fans" to each base. For this, we connect to each base of a 
computation chain a structure which consists of u many chains of each 
finite length. To do so we follow Rubin ^28j: consider the structure 
whose domain is 0*01* and whose relation is given by xEy if and only 
if |x| = \y \ and y is the least lexicographic successor of x. This structure 
has a finite chain of every finite length. As in Lemma [2.21 we take the 
w-fold disjoint union of the structure and identify the bases of all the 
finite chains. We get a "fan" with infinitely many chains of each finite 
size whose base can be identified with a valid initial computation state. 
Also, the fan has an infinite component if and only if R^ does not hold 
of the input tuple corresponding to the base. The result is an automatic 
graph, Smooth{Ri) = {Di,Ei), which extends Conf{M.i). 

Connecting domain symbols to the computations of the re- 
lation. We apply the construction above to each Ri in the signature 
of C. Taking the union of the resulting automatic graphs and adding 
vertices for the domain, we have the structure (S* U UiDi, Ei, . . . , En) 
(where we assume that the Di are disjoint). We assume without loss of 
generality that each A^j has a different initial state, and denote it by 
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Li. We add n predicates Fi to the signature of the automatic structure 
connecting the elements of the domain of C with the computations of 
the relations Ri. 

Fi = {{Xq, . . . , Xrui-l, (A Li (Xo, . . . , Xrui-l), A, A)) 

Note that for x G S*, Ri{x) if and only if Fi{x, (A Li x, A, A)) holds and 
all Ei chains emanating from (A Li x, A, A) are finite. We have built the 
automatic structure 



Two technical lemmas are used to show that the Scott rank of A is 
close to a: 

Lemma 5.6. For x,y in the domain of C and for ordinal a, if x =q y 
then X =^ y. 

Proof. Let X = dom^ \ S*. We prove the stronger result that for 
any ordinal a, and for all x,y G E* and x',y' G X, if the following 
assumptions hold 



(1) X y; 

(2) {x',Ei : i = l...n)j( =f {y',Ei,: i = l...?7,)^ (hence the 



substructures in A are isomorphic) with f{x') = y'; and 
(3) for each x'^ G x', each i = l,...,n and each subsequence of 
indices of length rrii, 



then xx' =^ yy'. The lemma follows if we take x' = y' = X (the empty 
string) . 

We show the stronger result by induction on a. If a = 0, we need to 
show that for each i, k, k', ko, . . . , kr^-i, 



The first statement follows by assumption [21 since the isomorphism 
must preserve the Ei relations and maps x' to y' . The second statement 
follows by assumption [31 

Assume now that a > and that the result holds for all /? < a. 
Let X, 1/ G S* and x', y' E A he such that the assumptions of the 
lemma hold. We will show that xx' =^ yy' . Let j3 < a and suppose 
u G E*,-?/' G A. By assumption [H there is G S* such that xu =^ yv. 
By the construction (in particular, the smoothing steps), we can find 
a corresponding v' E A such that assumptions [21 [3] hold. Applying the 



^ = (S'^ U UA, ^1, • • • , ^n, i^l, • • • , i^n). 





and that 




16 



BAKHADYR KHOUSSAINOV AND MIA MINNES 



inductive hypothesis, we get that xux'u' =^ yvy'v' . Analogously, given 
V, v' we can find the necessary ft, v! . Therefore, xx' ='\ yy'. □ 

Lemma 5.7. If x e U UjDj, there is y e with STZ_a^{xx'u) < 
2 + Snciy). 

Proof. We use the notation Xp to mean the subset of X = A\'E* which 
corresponds to elements on fans associated with productive chains of 
the configuration space. We write Xjj to mean the subset of X which 
corresponds to the unproductive chains of the configuration space. 
Therefore, A = (J Xp U Xu, a disjoint union. Thus, wc will show 
that for each x G S*, x' G Xp, u G Xjj there is y G S* such that 
STlAixx'u) < 2 + STZciy). 

Given x,x',u, let y G E* be a minimal clement satisfying that x <Zy 
and that x' C {y,Ei,Fi : i = 1 . . .n)_4. Then we will show that y is 
the desired witness. First, we observe that since the unproductive part 
of the structure is disconnected from the productive elements we can 
consider the two independently. Moreover, because the structure of 
the unproductive part is predetermined and simple, for u,v & Xu, if 
u =\ V then {A,u) = {A,v). It remains to consider the productive 
part of the structure. 

Consider any z G E*, z' G Xp satisfying z' C {z, Ei, : i — 1 . . . n)^. 
We claim that SRj^{zz') < 2 + STZc{z). It suffices to show that for all 
a, for all w G E*, w' G Xp, 

zz' =^+° ww' =^ z =c w. 

This is sufficient for the following reason. If zz' =^'^''^c(^) ^j^^^^ 
z =^^c(2) ^ hence {C,z) = {C,w). Prom this automorphism, we 
can define an automorphism of A mapping zz' to unu' because zz' =\ 
ww' and hence for each i, the relative positions of z' and w' in the fans 
above z and w are isomorphic. Therefore, 2 + S7lc{z) > STZj^{zz'). 

So, we now show that for all a, for all w G E*, w' G Xp, zz' ww' 
implies that z =^ w. Wc proceed by induction on a. For a = 0, 
suppose that zz' =\ ww' . This implies that for each i and for each 
subsequence of length mi of the indices, the £'j-fan above Zj has an 
infinite chain if and only if the E'j-fan above Wj does. Therefore, Ri{zj) 
if and only if Ri{wj). Hence, z =° w, as required. For the inductive 
step, wc assume the result holds for all P < a. Suppose that zz' 
ww'. Let f3 < a and c G E*. Then 2 + j3 < 2 + a so by definition 
there is d G E*, cf G Xp such that zz'c ww'dd! . However, since 
2 + /3 > 1, J' must be empty (elements in E* cannot be 1-equivalent to 
elements in Xp). Then by the induction hypothesis, zc =^ wd. The 
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argument works symmetrically if we are given d and want to find c. 
Thus, z =^ w, as required. □ 

Putting Lemmas 15.61 and 15.71 together, we can prove the main result 
about our construction. 

Theorem 5.8. Let C be a computable structure and construct the au- 
tomatic structure A from it as above. Then STZ{C) < STZ{A) < 
2 + Sn{C). 

Proof. Let x be a tuple in the domain of C. Then, by the definition of 
Scott rank, S71a{x) is the least ordinal a such that for all y G dom(^), 
X =^ y implies that {A, x) = {A, y); and similarly for S7lc{x)- We first 
show that S7lyx{x) > SlZcix). Suppose SlZcix) = p. We assume for 
a contradiction that STZa{x) = 7 < /5. Consider an arbitrary ^ G S* 
(the domain of C) such that x =^ z. By Lemma [5.6[ x =\ z. But, the 
definition of 7 as the Scott rank of x in ^ implies that {A, x) = {A, z). 
Now, C is L^^^i^ definable in A and therefore inherits the isomorphism. 
Hence, (C,x) = (C,z). But, this implies that SlZc{x) < 7 < /3 = 
S7lc{x), a contradiction. 

So far, we have that for each x G S*, STZ^i^) ^ SlZc{x). Hence, 
since dom(C) C dom(^), 

Sn{A) = sup{>S7^^(x) + 1 : X G dom(^)} 

> sup{57^^(x) + 1 : X G dom(C)} 

> sup{57^c(x) + 1 : X G dom(C)} = 57^(C). 

In the other direction, we wish to show that S7l{A) < 2 + S1Z{C). 
Suppose this is not the case. Then there is xx'u G A such that 
S1Za{xx'u) > 2 + S1Z{C). By Lemma [5771 there is ?/ G such that 
2 + Snc{y) > 2 + Sn{C), a contradiction. □ 

Recent work in the theory of computable structures has focussed on 
finding computable structures of high Scott rank. Nadel [26j proved 
that any computable structure has Scott rank at most uj^^ + 1. Early 
on, Harrison |15| showed that there is a computable ordering of type 
uj^^{l + Tj) (where rj is the order type of the rational numbers). This 
ordering has Scott rank cuf ^ + 1, as witnessed by any element outside 
the initial set. However, it was not until much more recently that 
a computable structure of Scott rank cuf ^ was produced (see Knight 
and Millar [23]). A recent result of Cholak, Downey, and Harrington 
gives the first natural example of a structure with Scott rank cuf ^: the 
computable enumerable sets under inclusion [9]. 



18 



BAKHADYR KHOUSSAINOV AND MIA MINNES 



Corollary 5.9. There is an automatic structure with Scott rank uof . 
There is an automatic structure with Scott rank uj^^ + 1 . 

We also apply the construction to [H], where it is proved that there 
are computable structures with Scott ranks above each computable or- 
dinal. In this case, we get the following theorem. 

Theorem 11.31 For each computable ordinal a, there is an automatic 
structure of Scott rank at least a. 

6. Cantor-Bendixson Rank of Automatic Successor Trees 

In this section we show that there are automatic successor trees of 
high Cantor-Bendixson (CB) rank. Recall the definitions of partial 
order trees and successor trees from Section [TJ Note that if (T, <) is 
an automatic partial order tree then the successor tree {T,S), where 
the relation S is defined by S{x,y) {x < y) k, -Bz{x < z < y), 

is automatic. 

Definition 6.1. The derivative of a (partial order or successor) tree 
T, d{T), is the subtree of T whose domain is 

{x G T : X lies on at least two infinite paths in T}. 

By induction, d^{T) = T, d"'~^^{T) = d{d'^{T)), and for 7 a limit or- 
dinal, d^{T) = n/3<^d^(T). The CB rank of the tree, CB{T), is the 
least a such that d"(T) = d"+i(T). 

The CB ranks of automatic partial order trees are finite |T9]. This is 
not true of automatic successor trees. The main theorem of this section 
provides a general technique for building trees of given CB ranks. Be- 
fore we get to it, we give some examples of automatic successor ordinals 
whose CB ranks are low. 

Example 6.2. There is an automatic partial order tree (hence an au- 
tomatic successor tree) whose CB rank is n for each n E u. 

Proof. The tree T„ is defined over the n letter alphabet {ai, . . . , a„} as 
follows. The domain of the tree is a* • • • a* . The order <„ is the prefix 
partial order. Therefore, the successor relation is given as follows: 

^1 e^. _ j{a{' ■ ■ ■ af +\ ■ ■ ■ af a^+i} if 1 < z < n 

Note that if n = then the tree is empty, which is consistent with it 
having CB rank 0. It is obvious that T„ is an automatic partial order 
tree. The rank of T„ can be shown, by induction, to be equal to n. □ 
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The following examples code the finite rank successor trees uniformly 
into one automaton in order to push the rank higher. We begin by 
building an automatic successor tree T^+i of rank u + 1. We note 
that the CB ranks of all trees with at most countably many paths 
are successor ordinals. Thus, T^^+i will have countably many paths. 
Later, we construct a tree of rank cu which must embed the perfect tree 
because its CB rank is a limit ordinal. 

Example 6.3. There is an automatic successor tree T^^+i whose CB 
rank is a; + 1. 

Proof. Informally, this tree is a chain of trees of increasing finite CB 
ranks. Let T^^+i = ({0, 1}*, S) with S defined as follows: 

S{r) = {1"0, 1"+^} for all n 

S{Ou) = OuO for all u e {0, 1}* 
S(rOu) = {rOuO, r-^Oul} for n > l and u e {0, 1}* 

Intuitively, the subtree of rank n is coded by the set X„ of nodes 
which contain exactly n Is. By induction on the length of strings, we 
can show that range(5') = {0, 1}* and hence the domain of the tree is 
also {0, 1}*. It is also not hard to show that the transitive closure of 
the relation S satisfies the conditions of being a tree. It is also easy to 
see that T^+i is automatic. Finally, we compute the rank of T^+i. We 
note that in successive derivatives, each of the finite rank sub-trees Xn 
is reduced in rank by 1. Therefore 

d^{T) = 1*. 

But, since each point in 1* is on exactly one infinite path, d'^~^^{T) = 0, 
and this is a fixed-point. Thus, CB{T^+i) = a; -|- 1, as required. □ 

The following example gives a tree of rank u. The idea is to code 
the trees r„ provided above into the leftmost path of the full binary 
tree. 

Example 6.4. There is an automatic successor tree whose CB rank 
is cu. 

Proof. The tree is the full binary tree, where at each node on the left- 
most branch we append trees of increasing finite CB rank. Thus, define 
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Tu, = ({0, 1}* U {0, a}*, S) where S is given as follows: 

S{ulv) = {ulvO, ulvl} for all u,v e {0, 1}* 

5(0'*) = {0"+\ 0"1, 0"a} for all n 

S{au) = aua for all u G {0, a}* 

5(0"aM) = {O'^am, 0"-^aiiO} forn > 1 and u e {0, a}* 

Proving that T^^ is an automatic successor tree is a routine check. So, 
we need only compute its rank. Each derivative leaves the right part of 
the tree (the full binary tree) fixed. However, the trees appended to the 
leftmost path of the tree are affected by taking derivatives. Successive 
derivatives decrease the rank of the protruding finite rank trees by 1. 
Therefore, d'^iT^) = {0, 1}*, a fixed point. Thus, CB{T^) ^uj. □ 

To extend these examples to higher ordinals, we consider the prod- 
uct operation on trees defined as follows. Let (Ti,S'i) and (T2, ^2) 
be successor trees. The product of these trees is the tree (T, S) with 
domain T = Ti x T2 and successor relations given by: 



The following is an easy proposition. 

Proposition 6.5. Assume that Ti and T2 are successor trees of CB 
ranks a and (5, respectively, each having at most countably many paths. 
Then Ti x T2 has CB rank a + (3. Moreover, ifTi and T2 are automatic 
successor trees then so is the product. 

The examples and the proposition above yield tools for building au- 
tomatic successor trees of CB ranks up to u'^. However, it is not clear 
that these methods can be applied to obtain automatic successor trees 
of higher CB ranks. We will see that a different approach to building 
automatic successor trees will yield all possible CB ranks. 

We are now ready for the main theorem of this section. As before, we 
will transfer results from computable trees to automatic trees. We note 
that every computable successor tree (T, S) is also a computable partial 
order tree. Indeed, in order to compute if x |/, we effectively find the 
distances of y and x from the root. If y is closer to the root or is at the 
same distance as x then -i{x v)', otherwise, we start computing the 
trees above all z at the same distance from the root as x is. Then y must 
appear in one of these trees. Thus, we have computed whether x -<s y. 
Hence, every computable successor tree is a computable partial order 




y is root of T2 and {u — x, S2{y, v)) or {Si{x, u),y — v) 
y is not the root of T2 and u — x, S2{y, v). 
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tree. However, not every computable partial order tree is a computable 
successor tree. We have the following inclusions: 

Aut. PO trees C Aut. Succ. trees C Comp. Succ. trees C Comp. PO trees 

We use the fact that for each a < cjf ^ there is a computable successor 
tree of CB rank a. This fact can be proven by recursively coding up 
computable trees of increasing CB rank. 

Theorem 11.41 For a < there is an automatic successor tree of 

CB rank a. 

Proof. Suppose we are given a < uf^. Take a computable tree Ra of 
CB rank a. We use the same construction as in the case of well-founded 
relations (see the proof of Theorem 11.21) . The result is a stretched out 
version of the tree Ra, where between each two elements of the original 
tree we have a coding of their computation. In addition, extending 
from each x G S* we have infinitely many finite computation chains. 
Those chains which correspond to output "no" are not connected to 
any other part of the automatic structure. Finally, there is a disjoint 
part of the structure consisting of chains whose bases are not valid ini- 
tial configurations. By the reversibility assumption, each unproductive 
component of the configuration space is isomorphic either to a finite 
chain or to an cj-chain. Moreover, the set of invalid initial configura- 
tions which are the base of such an unproductive chain is regular. We 
connect all such bases of unproductive chains to the root and get an 
automatic successor tree, Tq,. 

We now consider the CB rank of Tq,. Note that the first derivative 
removes all the subtrees whose roots are at distance 1 from the root 
and are invalid initial computations. This occurs because each of the 
invalid computation chains has no branching and is not connected to 
any other element of the tree. Next, if we consider the subtree of Tq, 
rooted at some x G S*, we see that all the paths which correspond 
to computations whose output is "no" vanish after the first derivative. 
Moreover, x G d{Ta) if and only if x G d{Ra) because the construction 
did not add any new infinite paths. Therefore, after one derivative, 
the structure is exactly a stretched out version of d{Ra). Likewise, 
for all P < a, d^^iTa) is a stretched out version of d^{Ra). Hence, 
CB{Ta) = CB{rJ) = a. □ 

Automatic successor trees have also been recently studied by Kuske 
and Lohrey in [23]. In that paper, techniques similar to those above 
are used to show that the existence of an infinite path in an automatic 
successor tree is S]^-complete. In addition, Kuske and Lohrey look at 
graph questions for automatic graphs and show that the existence of 
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a Hamiltonian path is Sj-complete whereas the set cover problem is 
decidable. 

7. Conclusion 

This paper studies the complexity of automatic structures. In par- 
ticular, we seek to understand the difference in complexity between 
automatic and computable structures. We show that automatic well- 
founded partial orders are considerably simpler than their computable 
counterparts, because the ordinal heights of automatic partial orders 
are bounded below uj^ . On the other hand, computable well-founded 
relations, computable successor trees, and computable structures in 
general can be transformed into automatic objects in a way which (al- 
most) preserves the ordinal height, Cantor-Bendixson rank, or Scott 
ranks (respectively). Therefore, the corresponding classes of automatic 
structures are as complicated as possible. 
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